Online optimization algorithms
نویسنده
چکیده
This project surveys some recent algorithms and results in the field of online learning theory [5][6][7]. The problem context is that of an online decision problem, where one must choose a point xt from a fixed set K for each round t. After a choice has been made, a cost function ft(x) for that round is revealed and used to compute the cost of that decision. On the next round t + 1, a new point xt+1 must be chosen, a new cost function ft+1(x) will be revealed, and so on. The goal then is to minimize the regret R, the difference between the cumulative cost of the single best point chosen in hindsight x and the cumulative cost of the sequence of points chosen by the online procedure x1...T .
منابع مشابه
STRUCTURAL OPTIMIZATION PROBLEMS OF THE ISCSO 2011-2015: A TEST SET
Beginning in 2011 an international academic contest named as International Student Competition in Structural Optimization (ISCSO) has been organized by the authors to encourage undergraduate and graduate students to solve structural engineering optimization&nbs...
متن کاملEfficient algorithms for online convex optimization and their applications
In this thesis we study algorithms for online convex optimization and their relation to approximate optimization. In the first part, we propose a new algorithm for a general online optimization framework called online convex optimization. Whereas previous efficient algorithms are mostly gradient-descent based, the new algorithm is inspired by the Newton-Raphson method for convex optimization, a...
متن کاملMeta Online Learning: Experiments on a Unit Commitment Problem
Online learning is machine learning, in real time from successive data samples. Meta online learning consists in combining several online learning algorithms from a given set (termed portfolio) of algorithms. The goal can be (i) mitigating the effect of a bad choice of online learning algorithms (ii) parallelization (iii) combining the strengths of different algorithms. Basically, meta online l...
متن کاملA Unified Approach to Adaptive Regularization in Online and Stochastic Optimization
We describe a framework for deriving and analyzing online optimization algorithms that incorporate adaptive, data-dependent regularization, also termed preconditioning. Such algorithms have been proven useful in stochastic optimization by reshaping the gradients according to the geometry of the data. Our framework captures and unifies much of the existing literature on adaptive online methods, ...
متن کاملOnline Scheduling of Jobs for D-benevolent instances On Identical Machines
We consider online scheduling of jobs with specic release time on m identical machines. Each job has a weight and a size; the goal is maximizing total weight of completed jobs. At release time of a job it must immediately be scheduled on a machine or it will be rejected. It is also allowed during execution of a job to preempt it; however, it will be lost and only weight of completed jobs contri...
متن کاملBlack-Box Reductions for Parameter-free Online Learning in Banach Spaces
We introduce several new black-box reductions that significantly improve the design of adaptive and parameterfree online learning algorithms by simplifying analysis, improving regret guarantees, and sometimes even improving runtime. We reduce parameter-free online learning to online exp-concave optimization, we reduce optimization in a Banach space to one-dimensional optimization, and we reduce...
متن کامل